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SHOT  NOISE  GENERATED  BY  A  SEMI -MARKOV  PROCESS 


Woollcott  Smith 

In  this  note  a  model  for  shot  noise  generated  by  a  semi-Markov  process  is 
developed.  The  moments  of  the  shot  noise  process  are  found,  and  some  appli¬ 
cations  of  this  model  are  briefly  indicated. 

SECTION  1:  A  General  Shot  Noise  Model 

Before  developing  the  shot  noise  model,  we  introduce  and  define  some  no¬ 
tation  for  semi -Markov  processes.  In  semi-Markov  processes,  S-MP,  as  in 
Markov  processes,  each  jump  is  a  regeneration  point  eliminating  the  influence 
of  past  events.  However,  in  the  S-MP  the  distribution  of  times  between 
jumps  is  arbitrary,  whereas  in  the  Markov  process  the  sojourn  time  in  any 
state  is  exponentially  distributed.  Let  t  be  the  time  of  the  n-th  tran¬ 
sition,  n  *  0,1,2 .  Throughout  this  paper,  we  let  t^  *  0.  Let  be 

the  value  of  the  S-MP  after  the  n-th  transition.  The  process  X  ib  a 

n 

homogeneous  Markov  chain.  The  S-MP,  X(t),  is  completely  defined  by  a  set  of 
defective  probability  distributions,  G^;  G^(“)  5  ^  anc*  CO)  ■  0. 

G^(t)  is  the  probability  that  the  sojourn  time  in  state  i  has  duration 
5  t  and  ends  with  a  jump  to  state  j, 

cij(t)  ■  ti,+rVt|v1>- 

In  this  paper,  we  will  assume  that  Che  S-MP,  X(t),  has  a  finite  number  of 
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states  i,  i  «  0,1,2,...,N,  that 


N 

(1)  S.(t)  -  I  G. , (t) 

j-0 

is  not  a  lattice  distribution  function,  and  that 


(2) 


j  tdS ,  (t)  <  «. 
J0 


Let  P  denote  the  one-step  transition  matrix  for  the  embedded  Markov  chain 

X^,  P  -  [G^  (*>)],  We  assume  that  the  matrix  P  is  irreducible  and  has  the 

stationary  probability  vector  ir  »  (t-.tt,  , . . .  ,tt„)  , 

0  1  N 


(3)  rr  “  nP . 


The  shot  noise  process,  Y(t),  is  then  defined  by 

<4)  *(t)  “  l  ,  X  ,  W  ) 

0<t  it  n  n  n 

n 

where  f(t,j,w)  is  a  known  function  and  {W^}  is  a  sequence  of  independent 
random  variables  with  distribution  function 


(5)  H(x)  -  Pr(W  s  x). 

n 

The  shape  of  the  n-th  pulse  which  is  initiated  at  time  t  depends  on  the 
state  of  the  S-MP,  X^,  and  the  random  variable  W^.  The  model  presented  here 
is  a  straightforward  generalization  of  a  shot  noise  process  generated  by  a 
renewal  process  investigated  by  Takfics  (1956). 

We  define  the  distribution  function  for  the  process  Y(t), 


Fj(tfy)  -  Pr(Y<t)  s  y|X0  -  j), 


and  let 


(t,m) 


/+*> 


imx 

e 


(6) 


d*  Fjc'>x> 
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denote  its  characteristic  function.  Let 


/+<» 


(7) 


ii“£(t-3'x)  m(%) 


denote  the  characteristic  function  of  a  single  impulse. 

THEOREM  1:  The  functions  4>^(t,o))  satisfy  the  system  of  linear  integral 
equations 


N 


(8) 


4>i(t,uj) 


l 

j“0  J 


N 


r  (t-t‘,w)  *  (t-t'.W)  dG  (t1)  +  1  -  l  G  (t). 
0  3  3  13  3 


PROOF:  Y(t)  a  0  if  t^  >  t  and  if  t^  <  t  then  Y(t)  is  the  sum  of  two 
random  variables,  f(t-t^,W^)  and  Y(t-t^).  If  ^(t.wix.j)  denotes  the 
characteristic  function  of  the  conditional  distribution  of  Y(t),  given  that 
the  first  transition  occurs  at  time  t^  *  x  and  is  a  transition  to  the  state 
j ,  then 


$t(t,u>  x,j) 


(t-x.oOTj  (t~x,w)  x  s  t 


,1  x  >  t.) 

From  this  expression,  we  obtain  the  unconditional  characteristic  function 
given  in  equation  (8). 


The  general  solution  for  this  system  of  integral  equations  is  not  known; 
however,  one  can  obtain  from  (8)  equations  for  the  moments  of  the  Y(t)  pro¬ 
cess  which  can  be  solved.  Let 

(9)  Mn(t;j)  -  E[Yn(t)jXQ  -  j) 
and  let 

(10)  Mn  -  Urn  Mn(t;j)  { 

^  4  » 


4 


denote  the  moments  of  the  stationary  process  if  it  exists.  Further  let 


(11)  An(t,j)  "  E[f  (t,j,W)] 


THEOREM  2:  The  first  two  moments  of  the  Y(t)  process  are 


MjUjj) 


t  N 

l  A. (t-t',i)  dm  ,  (t*) 
0  i-0  3 


(12) 

and 

ct  N 

(13)  M  (t;j)  » 

j0  i=>0 

provided  that  the  integrals  exist,  where 

,(n> 


l  |2M1(t-t';i)X1(t-t,,i)  +  X2(t-t,,J)J  dmji(t'), 


(14) 


“ij(t) 


l  ^  (t)} 

n-1  3 


,(n) 


and  Gv'4/ ,  ,  is  the  n-fold  convolution 

1  j 


G(n)i:)(t) 


ft  N 


0  k-Q 


l  GU"1}kj( t-f)  dGlk(f). 


ik' 


If  as  t  -*■  «>  tX^(t,i)  -*•  0  and  tA2(t»l)  0  for  1  "  1,2,  then 

the  first  and  second  moments  of  the  stationary  process  are 
.  c®  N 


(15) 

and 

(16) 


M.  •  - 
1  a 


[  n  A  ( t , i)  dt 
0  i-0 


M- 


»  N 


l  ir.(2M  (t;  i)A  (t,i)  +  X2(t,i)>  dt, 
i-0  1  ; 


provided  that  the  integrals  *»xist,  where 


N 


a  -  [ 

i-0 


ir  and  are  defined  in  (2)  and  (3). 
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PROOF.  Differentiating  (8)  with  respect  to  w  and 


plying  by  -i  we  obtain 


setting  u>  *>  0  and  multi- 


(17)  Ml(t;J)  ’  J0  Jo  dGjk(t’)f  j  .  0,1,2,. .,N. 

This  system  of  Volterra  integral  equations  (Tricomi  (1957)  p.  40)  has  a  solu¬ 
tion  given  by  (12).  One  obtains  the  equations  for  the  second  moments  by  dif¬ 
ferentiating  (8)  twice  with  respect  to  «  and  soiving  the  corresponding  system 
of  integral  equations. 

To  show  that  (15)  holds,  we  first  write 
,, 0.  ft/2  N 

(18)  Urn  „  Un  J  Al(t-f,i)  dm  .  (t 1 ) 

c  t  ~  '0  i=>0  1  Ji 


t  N 

+  Lim  I  X  .(ft'.i)  dm,  ,  (t1). 


A  well-known  result  for  Markov  renewal 


t  -*•  »  ;t/2  i«0  J1 

processes,  Pyke  (1961),  states  that 


(®jj  (t+h)-m  ,  (t))  a  _i_ 
t  -*■  oo  ji  a 

Under  the  conditions  of  theorem  2.  the  first  integrn!  on  the  right-hand  side 
of  (18)  goes  to  0  as  t  -  and  using  the  result  given  in  (19)  as  t  .  . 

the  second  term  goes  to  (15).  The  proof  for  the  second  moment  follows  by  the 
same  general  argument. 

The  first  moment,  for  the  stationery  process  are  obtained  directly  from 
equation  (12).  However,  to  obtain  an  explicit  solution  for  the  second  moment 
m2*  we  consider  the  special  case 

(20)  f(t,j,w)  ■  wa^exp(-Y^ t) . 

If  ElU]  »  w  <  «>  and  Var(W)  *  02  <  t|,en 


^(tpj) 


uaj0xp(-y^t) 


and 
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(22)  X2(t,j)  »  (uZ+o2)  a^2  exp(-2y  t). 

The  exponential  form  of  and  X^  enables  us  to  take  advantage  of  the  re¬ 

lationship  between  the  convolution  operator  and  the  Laplace-Stieltjes  trans- 


forms . 

Let 

GVs) 

and  (s) 

denote  the  Laplace-Stieltjes  transform  of 

Gy(t) 

and 

V0 

respectively. 

It  can  be  shown  (Pyke  (1961))  that 

(23)  M*(s)  »  G*(s) [1-G*(s) ]~^ 


where  M*  and  G* 

G1*  respectively, 
transform  of  (12)  is 


are  N  by  N  matrices  whose  ij-th  element  is 
For  the  special  case  that  we  are  considering, 


m*  and 
the  Laplace 


N  a. 


(24) 


M*n(s;j) 


I 


m*. , (s). 


1-0  V"  J1 

Making  use  of  the  exponential  form  of  A^,  equation  (16)  becomes 

N 


i’3) 


M. 


i»0 


2  "  i  l  V +  — 


2.22. 

a  ,  (u  +o  ) 


2Y. 


Equations  (25),  (24)  and  (23)  then  give  a  straightforward,  if  somewhat  cumber¬ 
some,  method  for  computing  the  variance  of  this  stationary  process. 

In  the  interest  of  brevity,  we  have  not  discussed  other  properties  of  the 
Y(t)  process  that  can  be  obtained  by  similar  arguments.  For  instance,  one 
can  obtain  from  (8)  equations  for  all  the  moments  of  the  Y(t)  process.  The 
covariance  function  of  the  Y(t)  process  can  be  found  directly  from  the  re¬ 
sults  given  here  by  defining  3  iv- j  process  Z(t)  ■  Y(t)  +  Y ( t+h ) .  This  pro¬ 
cess  is  also  a  shot  noise  process  and  the  covariance  of  the  Y(t)  process 
can  be  found  from  the  variance  of  the  Z(t)  process,  since 


-  *{Var(Z(0)  -  Var (Y(t) )  -  Var(Y(t+h) ) ] . 

A. 


Cov(Y(t) ,Y(t+h) ) 
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SECTION  2:  Discussion 


A  shot  noise  process  generated  by  a  semi-Markov  process  can  arise  in  many 
situations  where  for  various  reasons  one  cannot  consider  the  impulses  to  be 
generated  by  a  renewal  process.  One  such  situation  is  the  modeling  of  traffic 
noise  generated  by  automobiles  on  a  highway.  This  model  has  been  described  by 
Marcus  (1971). 

In  neurophysiology,  the  analysis  of  neural  spike  trains  indicates  that 
the  interspike  times  are  often  serially  dependent  random  variables  (Perkel, 
Gecstein  and  Moore,  1967).  Serial  dependence  can  be  simply  introduced  by 
using  S-MPs.  Models  for  neuron  firing  proposed  by  Coleman  and  Gastwirth 
(1969)  lend  to  spike  train  processes  that  can  be  described  by  semi-Markov 
processes  (Smith,  1971). 

Shot  noise  models  can  also  be  applied  to  queueing  theory.  Tak&cs  (1958)  has 
pointed  out  that  the  infinitely  many  server  queue  is  a  special  case  of  the 
shot  noise  process.  In  particular  the  S-MP/GI/®  queue  is  a  special  case  of 
the  model  developed  in  this  note  where 


fl  if  0  5  t  S  w 
f(t,i,v)  =  < 

'“0  otherwise 

and  the  random  variable  represents  the  service  time  of  the  n-th  individual. 

For  simplicity,  we  have  discussed  only  the  one-sided  impulse  function, 
f(t,i,w)  ■  0  for  t  <  0.  However,  the  two-sided  impulse  function  can  also  be 
analysed  using  the  same  techniques.  For  instance  in  the  two-sided  case 
equation  (8)  of  Theorem  1  becomes 


(26) 


$t(t,w) 


N 

l 


J-l 


r  (t-t’.w)  *  (c-t\«)  dc  (t) 

0  J  J 


the  integral  equations  for  the  one-sided  impulse  function  is  of  course  a 
special  case  of  this  equation.  From  (26)  one  can  find  Integral  equations  for 


the  moments  of  the  two-sided  shot  noise  process.  For  the  two-sided  process 
the  results  in  Theorem  2  are  the  same  except  that  the  upper  limits  of  inte¬ 
gration  in  equations  (12)  and  (13)  are  infinity  instead  of  t,  and  the  lower 
limits  of  equations  (15)  and  (16)  are  (-»)  instead  of  0.  Marcus  (1971) 
used  this  two-sided  shot  noise  model  to  describe  traffic  noise  near  a  highway. 
He  found  the  mean  and  variance  of  the  stationary  process  by  using  different, 
more  heuristic  methods. 

In  general,  the  usefulness  of  the  shot  noise  process  discussed  in  this 
note  is  that  complex  stochastic  systems  can  be  represented  in  a  model  which  can 
be  analyzed  using  straightforward  mathematical  techniques. 
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